The Sounds of Silence: Towards Automated Evaluation of Student Learning in a Reading Tutor that Listens
نویسندگان
چکیده
We propose a paradigm for ecologically valid, authentic, unobtrusive, automatic, data-rich, fast, robust, and sensitive evaluation of computer-assisted student performance. We instantiate this paradigm in the context of a Reading Tutor that listens to children read aloud, and helps them. We introduce inter-word latency as a simple prosodic measure of assisted reading performance. Finally, to validate the measure and analyze performance improvement, we report initial experimental results from the first extended in-school deployment of the Reading Tutor. Content areas: computer aided education, spoken language understanding, user interfaces, cognitive modeling, multimedia
منابع مشابه
Can a Reading Tutor that Listens use Inter-word Latency to Assess a Student's Reading Ability?
This paper describes our use of inter-word latency, the delay before a student speaks a word in the course of reading a sentence, to assess oral reading automatically. The context of our study is a Reading Tutor that uses automated speech recognition to listen to children read aloud. Using the data from 58 students from grades 1 through 4, we used inter-word latency to predict scores on externa...
متن کاملEstimating the Effectiveness of Conversational Behaviors in a Reading Tutor that Listens
Project LISTEN’s Reading Tutor listens to children read aloud, and helps them learn to read. Besides user satisfaction, a primary criterion for tutorial spoken dialogue agents should be educational effectiveness. In order to learn to be more effective, a spoken dialogue agent must be able to evaluate the effect of its own actions. When evaluating the effectiveness of individual actions, rather ...
متن کاملWhy and How Our Automated Reading Tutor Listens
Project LISTEN’s Reading Tutor listens to children read aloud, and helps them learn to read. This paper outlines how it gives feedback, how it uses ASR, and how we measure its accuracy. It describes how we model various aspects of oral reading, some ideas we tried, and lessons we have learned about acoustic models, lexical models, confidence scores, language models, alignment methods, and proso...
متن کاملTraining a confidence measure for a reading tutor that listens
One issue in a Reading Tutor that listens is to determine which words the student read correctly. We describe a confidence measure that uses a variety of features to estimate the probability that a word was read correctly. We trained two decision tree classifiers. The first classifier tries to fix insertion and substitution errors made by the speech decoder, while the second classifier tries to...
متن کاملDetecting prosody improvement in oral rereading
A reading tutor that listens to children read aloud should be able to detect fluency growth – not only in oral reading rate, but also in prosody. How sensitive can such detection be? We present an approach to detecting improved oral reading prosody in rereading a given text. We evaluate our method on data from 133 students ages 7-10 who used Project LISTEN‟s Reading Tutor. We compare the sensit...
متن کامل